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DETAILED ACTION 
Claim Rejections - 35 USC §112 

1 . The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

2. Claim 10 recites the limitation "the robotic microscope" in the first line of the 
claim. There is insufficient antecedent basis for this limitation in the claim. The 
examiner suggests that claim 10 is made to depend from claim 9. 

Claim Rejections - 35 USC § 101 

3. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

4. Claims 14-20 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-statutory subject matter. Program code cannot directly be claimed; 
the code must be stored on a computer readable medium to avoid being non-statutory 
subject matter. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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6. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

7. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

8. Claims 1, 4- 14, 17 - 24, 26 and 27 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Soenksen (6,71 1 ,283) in view of Zhou (6,633,659). 

9. In regards to claim 1 , Soenksen discloses a method comprising: 

Capturing an image of a tissue microarray at a first magnification, i.e., resolution, 
the tissue microarray including a plurality of disks, each disk including a sample of 
biological specimen (figure 4; col. 7, lines 12-16; col. 19, lines 10 - 12); 

Locating a first group of disks from the plurality of disks using one or more visual 
features of the first group of disks (col. 20, lines 57 - 61 : Normal and abnormal cells are 
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two different possible groupings for the disks. These cells are identified by using one or 
more visual features.); 

Identifying a grid defined by the first group of disks (col. 1 7, lines 8-10: 
Calibration markings are used in the method, which are similar to grid lines); 

Locating a second group of disks from the plurality of disks using the identified 
grid to locate disks which do not include the one or more visual features of the first 
group of disks (col. 20, lines 57 - 61 ); 

Capturing an image of each one of the first group of disks and second group of 
disks at a second magnification, i.e., higher resolution, (col. 19, lines 12 - 15); and 

Storing the captured images (In figure 1, Soenksen discloses a memory (36) for 
storing captured images). 

Soenksen discloses in lines 8-10, column 17 that calibration markings are 
used. Soenksen however, does not disclose using gridlines in the fashion described in 
these claims, nor is information from the first group used to locate a second group. 
10. Zhou teaches in the paragraph starting at column 10, line 47 that grid lines are 
identified on the microarray. These grid lines are used both to separate groups and to 
identify disks, which are located at grid line intersection points (refereed to as grid 
point). Zhou discloses grid points in the paragraph starting at column 13, line 30. It 
should be noted that in the same paragraph Zhou discloses using templates to identify 
disks. Finally in the paragraph starting at column 14, line 15 Zhou discloses that the 
identified grid is used "to aid in fixing the locations of other probable sub-grids whose 
exact positions in their respective sub-grid regions remain uncertain". 
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1 1 . Therefore it would have been obvious to one having ordinary skill in the art at the 
time of the invention to use grid lines, including a method to find those grid lines, to both 
identify disks and to use previously located grid lines to find other grid lines as taught by 
Zhou along with the method for imaging microarrays as disclosed by Soenksen. 
Microarrays consist of samples in a grid pattern, by using those grid lines the accuracy 
in finding and evaluating disks in the method disclosed by Soenksen could be 
increased. 

1 2. In regards to claim 4, Soenksen in view of Zhou discloses the method of claim 1 
wherein locating the first group of disks comprises convolving the image of the tissue 
microarray with a disk template that includes the one or more visual features 
(Soenksen, col. 20, lines 57 - 61 ; Zhou, col. 1 3, lines 32 - 34: One particular visual 
feature used in the template is the diameter of the disks. Using a template to identify a 
disk would make an excellent first pass to identify disks that are of interest, this would 
be a way of speeding up the method disclosed by Soenksen as well as improving 
reliability.). 

13. In regards to claim 5, Soenksen discloses the method of claim 1 further 
comprising quantitatively analyzing the captured images of each one of the first group of 
disks and the second group of disks to obtain quantitative data (Soenksen, in figure 4 
that upon imaging the microarray the image is analyzed (step 214); Soenksen, col. 20, 
lines 57-61: During analysis quantitative data is obtained.). 

14. In regards to claim 6, Soenksen discloses the method of claim 5 further 
comprising storing the location and the quantitative data for each one of the first group 
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of disks and the second group of disks in a database (Soenksen, col. 13, lines 14-17: 
Imagery data is available for viewing over a network. Inherently some form of data 
storage is needed to allow the imagery data to be available to a network. Official notice 
is taken that it is well known in the art that a database is an efficient means of storing 
data structures especially when there are many copies of a data structure. As the 
method disclosed by Soenksen will most likely be used on many microarrays there will 
be many microarray data structures that will need to be stored, a database is the most 
likely and best means to provide storage.). 

15. In regards to claim 7, Soenksen discloses the method of claim 6 further 
comprising providing access to the database over a network to one ore more remote 
clients (Soenksen, col. 13, lines 14 - 17). 

16. In regards to claim 8, the method of claim 1 wherein capturing the image of the 
tissue microarray at the first magnification, i.e., resolution, further comprises combining 
a plurality of portions of the tissue microarray (Soenksen, figure 4, step 202: The 
microarray is captured as series a of line images. Those line images are then 
assembled into one image in step 212). 

17. In regards to claim 9, Soenksen the method of claim 1 wherein a robotic 
microscope, i.e., scanner, is employed to capture the image of the tissue microarray 
and to capture the image of each one of the first group of disks and the second group of 
disks (Soenksen, col. 16, lines 41 - 52). 
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18. In regards to claim 10, Soenksen discloses the method of claim 1 wherein the 
robotic microscope, i.e., scanner, is accessible over a network (Soenksen, col. 21 , lines 
3-7). 

19. In regards to claim 1 1 , Soenksen discloses the method of claim 1 wherein the 
method is performed by a robotic microscope, i.e., scanner, under control of a computer 
program without user intervention to autonomously capture and archive magnified 
images of each disk in the tissue microarray (Soenksen, col. 12, lines 35 - 39; 
Soenksen, col. 16, lines 41 - 52). 

20. In regards to claim 12, Soenksen discloses the method of claim 1 1 further 
comprising autonomously analyzing each captured image and storing a result of each 
autonomous analysis (Soenksen, col. 16, lines 41 - 52; storage has already been 
previously discussed). 

21. In regards to claim 13, Soenksen discloses the method of claim 1 wherein the 
one or more visual features include matching to a disk template (Soenksen, col. 20, 
lines 57 - 61 ; Zhou, col. 1 3, lines 32 - 34). 

22. In regards to claim 14, claim 14 is rejected for the same reasons as those used 
to reject claim 1 . The argument is analogous to that presented above for claim 1 , and 
therefore the rejection to claim 1 is equally applicable to claim 14. 

23. In regards to claim 17, claim 17 is rejected for the same reasons as those used 
to reject claim 4. The argument is analogous to that presented above for claim 4, and 
therefore the rejection to claim 4 is equally applicable to claim 17. 
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24. In regards to claim 18, claim 18 is rejected for the same reasons as those used 
to reject claim 5. The argument is analogous to that presented above for claim 5, and 
therefore the rejection to claim 5 is equally applicable to claim 18. 

25. In regards to claim 19, claim 19 is rejected for the same reasons as those used 
to reject claim 6. The argument is analogous to that presented above for claim 6, and 
therefore the rejection to claim 1 is equally applicable to claim 19. 

26. In regards to claim 20, claim 20 is rejected for the same reasons as those used 
to reject claim 9. The argument is analogous to that presented above for claim 9, and 
therefore the rejection to claim 9 is equally applicable to claim 20. 

27. In regards to claim 21 , Soenksen discloses a system comprising: 

Capturing means, i.e., scanner 1 1 , for capturing an image of tissue microarray at 
a first magnification, i.e., resolution, the tissue microarray including a plurality of disks, 
each disk including a sample of a biological specimen (figure 4; col. 7, lines 12-16; col. 
19, lines 10 -12). 

First locating means for locating a first group of disks from the plurality of disks 
using one or more visual features of the first group of disks (col. 20, lines 57 - 61 : 
Normal and abnormal cells are two different possible groupings for the disks. These 
cells are identified by using one or more visual features.); 

Identifying means for identifying a grid defined by the first group of disks (col. 17, 
lines 8-10: Calibration markings are used in the method, which are similar to grid 
lines); 
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Second locating means for locating a second group of disks from the plurality of 
disks using the identified grid to locate disks which do not include the one ore more 
visual features of the first group of disks (col. 20, lines 57 - 61 ); 

The capturing means further for capturing an image of each one of the first group 
of disks and the second group of disks at a second magnification, i.e., resolution (col. 
19, lines 12-15); and 

Storing means for storing the captured images (In figure 1 , Soenksen discloses a 
memory (36) for storing captured images). 

Soenksen discloses in lines 8-10, column 17 that calibration markings are 
used. Soenksen however, does not disclose using gridlines in the fashion described in 
these claims, nor is information from the first group used to locate a second group. 

28. Zhou teaches in the paragraph starting at column 10, line 47 that grid lines are 
identified on the microarray. These grid lines are used both to separate groups and to 
identify disks, which are located at grid line intersection points (refereed to as grid 
point). Zhou discloses grid points in the paragraph starting at column 13, line 30. It 
should be noted that in the same paragraph Zhou discloses using templates to identify 
disks. Finally in the paragraph starting at column 14, line 15 Zhou discloses that the 
identified grid is used "to aid in fixing the locations of other probable sub-grids whose 
exact positions in their respective sub-grid regions remain uncertain". 

29. Therefore it would have been obvious to one having ordinary skill in the art at the 
time of the invention to use grid lines, including a method to find those grid lines, to both 
identify disks and to use previously located grid lines to find other grid lines as taught by 
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Zhou along with the system for imaging microarrays as disclosed by Soenksen. 
Microarrays consist of samples in a grid pattern, by using those grid lines the accuracy 
in finding and evaluating disks in the system disclosed by Soenksen could be increased. 

30. In regards to clam 22, Soenksen discloses in figure 1 a computer (44) and an 
imaging device (11). Soenksen discloses in the paragraph starting at column 13, line 
14 that the imaging device is controlled by the computer. The imaging device is 
designed to take images, which are sent to the computer for processing. As shown in 
previous rejections the system is designed for imaging microarrays. In lines 30 - 36 on 
column 21 Soenksen discloses that particular areas can be selected for imaging, this 
requires a specific location, in the same grouping of lines a high resolution is disclosed 
which requires that the system be provided with a specific magnification. The rest of this 
claim has been dealt with in claims 1 and 4. Please see these claims for reasons of 
rejection. 

31 . In regards to claim 23, Soenksen discloses the system of claim 22 wherein the 
computer communicates with the imaging device through a local area network 
(Soenksen discloses in figure 1 a network 42 for the computer 44 to communicate with 
the imaging system 1 1 ). 

32. In regards to claim 24, Soenksen discloses the system of claim 22 wherein the 
computer communicates with the imaging device through an internetwork (Soenksen, 
col. 13, lines 7- 10). 

33. In regards to claim 26, Soenksen discloses the system of claim 22 further 
comprising a database for storing, for each disk of the first group of disks and the 
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second group of disks, and image of the disk, a location of the disk, and a quantitative 
analysis of the disk (Soenksen, col. 13, lines 14-17: Imagery data is available for 
viewing over a network. Inherently some form of data storage is needed to allow the 
imagery data to be available to a network. Official notice is taken that it is well known in 
the art that a database is an efficient means of storing data structures especially when 
there are many copies of a data structure. As the system disclosed by Soenksen will 
most likely be used on many microarrays there will be many microarray data structures 
that will need to be stored, a database is the most likely and best means to provide 
storage.). 

34. In regards to claim 27, Soenksen discloses the system of claim 26 wherein the 
database is accessible from one or more remote computers through an internetwork 
(Soenksen, col. 13, lines 14-17) 

35. Claims 2, 3, 15 and 16 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Soenksen (6,71 1 ,283) in view of Zhou (6,633,659) as applied to 
claims 1 and 14 above, and further in view of Sugiyama (5,616,905). 

36. In regards to claim 2, Soensken (as modified by Zhou) discloses identifying grid 
lines. However Soensken (as modified by Zhou) does not disclose using a Hough 
transform to identify these grid lines. 

37. Sugiyama teaches in the paragraph starting at column 1 1 , line 34 that a Hough 
transform can be used to identify grid lines. 

38. Therefore it would have been obvious to one having ordinary skill in the art at the 
time of the invention to use a Hough transform to identify grid lines. Hough transforms 
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are well known as excellent line finding operations. As grid lines are by definition lines, 
using a Hough transform is a fast an efficient way to find the grid lines. 

39. In regards to claim 1 5, claim 15 is rejected for the same reasons as those used 
to reject claim 2. The argument is analogous to that presented above for claim 2, and 
therefore the rejection to claim 2 is equally applicable to claim 15. 

40. In regards to claim 3, Soensken in view of Zhou and further in view of Sugiyama 
discloses the method of claim 2 wherein locating a second group of disks comprises 
selecting locations at one or more intersections which do not include any of the first 
group of disks (As previously disclosed in the rejection of claim 1 grid points are used to 
find disk locations. So every disk is located at an intersection of grid lines. Also as 
disclosed in the rejection of claim 1 , Soensken discloses identifying two types of disks, 
abnormal and normal cells.). 

41 . In regards to claim 16, claim 16 is rejected for the same reasons as those used 
to reject claim 3. The argument is analogous to that presented above for claim 3, and 
therefore the rejection to claim 3 is equally applicable to claim 16. 

42. Claims 25 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Soenksen (6,71 1 ,283) in view of Zhou (6,633,659) as applied to claim 22 above, and 
further in view of Caroll (6,1 21 ,960). 

43. In regards to claim 25, Soenksen (as modified by Zhou) discloses in figure 1 a 
step of interactively reviewing an image (step 216). This step inherently requires a user 
interface. Soenksen (as modified by Zhou) however, does not disclose using a voice- 
activated command system for interfacing with this user interface. 
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44. Carrol teaches in the paragraph staring at column 3, line 53 that a voice- 
activated command system can be used for interfacing with a user interface. 

45. Therefore it would have been obvious to one having ordinary skill in the art at the 
time of the invention to use a voice-activated command system with the user interface 
disclosed by Soenksen. In a clutered lab a voice-activated interface might save space 
by eliminating a keyboard and mouse while allowing users who are not computer savvy 
the ability to use the system disclosed by Soenksen. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Christopher L Lavin whose telephone number is 703- 
306-4220. The examiner can normally be reached on M - F (8:30 - 5:00). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo Boudreau can be reached on (703) 305-4706. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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